Nodes Tab
Nodes Tab
#380
The Nodes report provides utilization details of the individual nodes that are part of node group. You can see key metrics including both peak and average utilization for both CPU and memory. These metrics highlight container performance and stability issues.
Figure: Nodes Tab
More significantly, you can now see the pods as a percentage of the maximum allowed on a node and identify where nodes are unable to host more pods, due to the maximum CPU and /or memory value being too low. i.e. a virtual constraint.
You can create filters at the column or table level. See Using Table Column Features.
Pre-Configured Views
The following pre-configured table views are provided to quickly show various issues in your environment. Specific filters have been set and selected columns are displayed to highlight the specified risk or waste issue.
Figure: Selecting a Node System View
The content of the table as well as the totals at the bottom reflect the applied filter settings. Not all columns may be displayed in a selected view, but you can add them at any time. See Using Table Column Features.
The folowing system views provide commonly used reports:
Table: Pre-Configured Views
|
System View |
View |
Description |
|---|---|---|
|
Default View |
N/A |
This is the most commonly used set of columns that provide a summary view of your nodes. CPU and memory utilization as a percentage of the total provide a visual indicator of the available capacity. |
|
All Data |
N/A |
All columns are displayed. All filters are cleared. Horizontal and vertical scroll bars are displayed so you can navigate the content of the table. |
|
System Views |
Inventory |
This view focuses on the number and type of nodes in your environments. |
|
Utilization |
This view shows how effectively the nodes are being used. |
|
|
GPU |
This view shows nodes with GPU allocated GPU resources. |
Node Details
This report provides the following details for a single node:
The following table lists the columns in alphabetical order for easy reference. The display order of the columns in the UI are for improved usability.
Table: Node Details Table - Listed in Alphabetical Order
|
Column |
Description |
|---|---|
|
Age (days) |
The number of days since the node was first discovered by Densify. |
|
Allocatable CPU (cores) |
The number of CPUs that can be allocated to pods. |
|
Allocatable Memory (GB) |
The amount of memory that can be allocated to pods. |
|
Cluster |
The cluster name containing the selected node group/nodes. |
|
CPU Utilization - Avg (%) |
The average CPU utilization for this node, during the past 7 days of history. The cell will be shaded when the value exceeds 90%. |
|
CPU Utilization - Peak (%) |
The maximum CPU utilization for this node, during the past 7 days of history. The cell will be shaded when the value exceeds 90%. |
|
First Seen Date |
The date, on which this instance was first discovered by Densify. |
|
Instance Type |
The node's instance type. In cases where the instance type cannot be determined (i.e. bare-metal, private cloud environments) the primary node type is indicated as: CPU x memory size, e.g. 8x16. A dash (-) indicates that the node instance details could not be determined. |
|
Last Seen Date |
The date, on which this instance last had CPU utilization data collected by Densify. |
|
Memory Utilization - Avg (%) |
The average memory utilization for this node, during the past 7 days of history. The cell will be shaded when the value exceeds 90%. |
|
Max Allowed Pods |
The optimal configuration for the maximum number of pods allowed on this node. |
|
Memory Utilization - Peak (%) |
The maximum memory utilization for this node, during the past 7 days of history. The cell will be shaded when the value exceeds 90%. |
|
The node name. The name is a hyperlink that opens a modal view of the Node Overview tab. |
|
|
Node CPU |
The total number of CPUs on this instance type. |
|
Node Group |
The name of the node group that contains the selected node. For nodes that do not belong to a node group, the node group value should be <cluster-name>-default” |
|
Node Memory (GB) |
The total amount of memory configured on this instance type. |
|
Node Group ID |
The unique identifier of the node group, to which this node currently belongs. |
|
Node Hours |
The total number of hours that this node has been up and running, based on CPU utilization, during the past 7 days of history. |
|
Node ID |
The unique identifier or the node. |
|
No. of Pods - Avg |
The average number of pods running on this node during the past 7 days of history. |
|
No. of Pods - Peak |
The maximum number of pods running on this node during the past 7 days of history. |
|
Pods (% of Max Allowed) |
The ratio of the maximum number of pods that were run versus the maximum that the node could support, in the last 7 days. Calculated as the (peak number of pods)/(maximum allowed pods). The cell will be shaded when the value exceeds 90%. |
GPU Details
The report provides the following additional GPU details for a single node:
The following table lists the columns in alphabetical order for easy reference. The display order of the columns in the table are for improved usability.
Table: Node Details Table - Listed in Alphabetical Order
|
Column |
Description |
|---|---|
|
Allocatable GPU (GPUs) |
The availble GPU that can be allocated to containers. |
|
Allocatable GPU Memory (MB) |
The availble GPU memory that can be allocated to containers. |
|
GPUs |
The available GPU configured on this node. |
|
GPU Memory (GB) |
The available GPU memory configured on this node. |
|
GPU Model |
The model of the GPU configured on this node. |
|
GPU Memory Utilization - Avg (%) |
This is the average GPU memory usage, as a percentage of the allocated GPU memory value. |
|
GPU Memory Utilization Peak (%) |
This is the peak GPU memory usage, as a percentage of the allocated GPU memory value. |
|
GPU Power Usage - Average (Watts) |
The average power usage for the average number of containers. |
|
GPU Power Usage - Peak (Watts) |
The highest peak value in watts, on the busiest container. Currently, this peak value is the 5-min average value and not the maximum within the 5-minute interval. |
|
GPU Utilization - Avg (%) |
This is the average GPU usage, as a percentage of the allocated GPU value. |
|
GPU Utilization - Peak (%) |
The is the peak GPU usage, as a percentage of the allocated GPU value. |
|
GPU Replicas |
The number of replicas using the allocated GPU. |
|
GPU Sharing Strategy |
The method used to allow multiple containers to share a single GPU. Possible values are None, MPS and Time-Slicing. |
|
Unallocated GPUs (GPUs) |
Available GPU resources that have not been allocated. |
Please observe the following for all node data:
- Missing data is indicated with a dash (-).
- A footnote indicates that the data is derived from the past 7 days of history. Nodes appear in the tree viewer immediately after data collection (last day), but values in some columns are based on 7 days of aggregated data.
Using the Utilization Chart
Clicking on any row in the tabular report, in the upper pane, shows the utilization details in the Utilization Charts.
If the lower pane has been collapsed, click the icon in the upper left corner to expand the pane.
Figure: Expanding the Lower Pane
Utilization charts show hourly min/max and sustained activity for the selected node. The charts show the current utilization and the request values for the selected metrics.
The following charts are available:
|
|
Note: If the required metrics are not available, the corresponding charts are not displayed.
|
Figure: Utilization Chart Data
|
Figure: Utilization Chart Request/Limit
|
The Y-axis is scaled dynamically to match the range of data. The orange line, indicating the current request setting is shown and the setting of the Y-axis scale also accounts for the request setting.
Hover over any time or date on the current or recommended lines and click to see the detailed data.
An icon in the corner of each chart provides a zoom feature:
|
You can zoom in on the chart for easier viewing. All information indicated above is provided so you can review hourly data for the selected container. Arrows on each side of the selected chart allow to scroll through the other available charts. |
Using the Legend
- You can select or de-select the data displayed on each chart using the legend located below the charts.
- Click an option to add or remove it from the displayed charts.
Figure: Utilization Charts - Using the Legend
Use the left/right arrows to scroll through the available utilization charts.
Expanded Modal View
|
Clicking the zoom button opens the chart in a modal view with additional options to view the collected and analyzed data. |
The following options allow you to view all details your data:
Table: Modal View Data Aggregation Options
|
Option |
Description |
|---|---|
|
ML Model |
Not available for nodes. |
|
Historical Daily |
The nodes's data, is aggregated for a single day. You can see the minimum, maximum, sustained and average values by clicking on any data point. The timezone of the data is UTC. Use the slider at the bottom to select the historical days of data to review. Up to 90 days of data is retained. |
|
Historical Hourly |
The node's data, aggregated for a single hour. Like the historical daily view, you can see the minimum, maximum, sustained and average values by clicking on any data point. The timezone of the data is UTC. Use the slider at the bottom to select the range of data to view. |
|
Historical (5 Min) |
Not available for nodes. |